Pandas Profiling Report

Dataset info

Number of variables	8
Number of observations	196203
Missing cells	0 (0.0%)
Duplicate rows	0 (0.0%)
Total size in memory	12.0 MiB
Average record size in memory	64.0 B

Variables types

Numeric	5
Categorical	1
Boolean	0
Date	1
URL	0
Text (Unique)	0
Rejected	1
Unsupported	0

Warnings

`city` has a high cardinality: 89 distinct values	Warning
`state` has constant value "WestBengal"	Rejected

city
Categorical

Distinct count	89
Unique (%)	< 0.1%
Missing (%)	0.0%
Missing (n)	0

Calcutta	122381
Arambagh	1929
Gangarampur	1366
Other values (86)	70527

Toggle details

Common values
Composition

Value	Count	Frequency (%)
Calcutta	122381	62.4%
Arambagh	1929	1.0%
Gangarampur	1366	0.7%
IngrajBazar	1352	0.7%
Krishnanagar	1344	0.7%
Panihati	1341	0.7%
RampurHat	1328	0.7%
Naihati	1267	0.6%
Halisahar	1257	0.6%
Bankura	1252	0.6%
Other values (79)	61386	31.3%

Max length	26
Mean length	8.301376635
Min length	5
Contains chars	True
Contains digits	False
Contains spaces	False
Contains non-words	False

device_id
Numeric

Distinct count	7436
Unique (%)	3.8%
Missing (%)	0.0%
Missing (n)	0
Infinite (%)	0.0%
Infinite (n)	0

Mean	4.27965896e+16
Minimum	-9.220061629e+18
Maximum	9.215085116e+18
Zeros (%)	0.0%

Toggle details

Quantile statistics

Minimum	-9.220061629e+18
5-th percentile	-8.273967625e+18
Q1	-4.600581613e+18
Median	8.280934626e+16
Q3	4.642411344e+18
95-th percentile	8.298932734e+18
Maximum	9.215085116e+18
Range	1.843514675e+19
Interquartile range	9.242992957e+18

Descriptive statistics

Standard deviation	5.320733179e+18
Coef of variation	124.3261024
Kurtosis	-1.21568132
Mean	4.27965896e+16
MAD	4.628248174e+18
Skewness	-0.01189279214
Sum	8.396819269e+21
Variance	2.831020157e+37
Memory size	1.5 MiB

Histogram with fixed size bins (bins=50)

Histogram with variable size bins (bins=[-9.22006163e+18 -9.21951131e+18 -9.21729987e+18 -9.21549583e+18 -9.20608783e+18 ... 9.20079676e+18 9.20811890e+18 9.20942743e+18 9.21506135e+18 9.21508512e+18], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
4.620270825e+18	777	0.4%
-5.858653205e+18	561	0.3%
8.088848068e+17	355	0.2%
5.867303249e+18	352	0.2%
-4.811787453e+18	344	0.2%
2.690316833e+18	330	0.2%
1.429828157e+18	287	0.1%
5.903812345e+18	275	0.1%
-3.115936487e+18	269	0.1%
8.948594075e+18	267	0.1%
Other values (7426)	192386	98.1%

Minimum 5 values

Value	Count	Frequency (%)
-9.220061629e+18	52	< 0.1%
-9.218960997e+18	6	< 0.1%
-9.215638742e+18	72	< 0.1%
-9.215352914e+18	18	< 0.1%
-9.206882336e+18	12	< 0.1%

Maximum 5 values

Value	Count	Frequency (%)
9.215085116e+18	28	< 0.1%
9.215037578e+18	2	< 0.1%
9.212543527e+18	2	< 0.1%
9.210120344e+18	4	< 0.1%
9.208734509e+18	28	< 0.1%

df_index
Numeric

Distinct count	196203
Unique (%)	100.0%
Missing (%)	0.0%
Missing (n)	0
Infinite (%)	0.0%
Infinite (n)	0

Mean	2981176.296
Minimum	2829979
Maximum	3252948
Zeros (%)	0.0%

Toggle details

Quantile statistics

Minimum	2829979
5-th percentile	2839789.1
Q1	2879029.5
Median	2928080
Q3	3091612.5
95-th percentile	3220811.9
Maximum	3252948
Range	422969
Interquartile range	212583

Descriptive statistics

Standard deviation	126440.2632
Coef of variation	0.04241287689
Kurtosis	-0.9404284929
Mean	2981176.296
MAD	112001.6947
Skewness	0.6901576069
Sum	5.849157328e+11
Variance	1.598714016e+10
Memory size	1.5 MiB

Histogram with fixed size bins (bins=50)

Histogram with variable size bins (bins=[2829979. 2951414.5 3000961.5 3001211.5 3001509.5 ... 3248395.5 3248420.5 3249317. 3249403.5 3252948. ], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
2885631	1	< 0.1%
2911783	1	< 0.1%
2938416	1	< 0.1%
2895407	1	< 0.1%
2893358	1	< 0.1%
2899501	1	< 0.1%
2897452	1	< 0.1%
2887211	1	< 0.1%
2885162	1	< 0.1%
2891305	1	< 0.1%
Other values (196193)	196193	> 99.9%

Minimum 5 values

Value	Count	Frequency (%)
2829979	1	< 0.1%
2829980	1	< 0.1%
2829981	1	< 0.1%
2829982	1	< 0.1%
2829983	1	< 0.1%

Maximum 5 values

Value	Count	Frequency (%)
3252948	1	< 0.1%
3252946	1	< 0.1%
3252941	1	< 0.1%
3252939	1	< 0.1%
3252936	1	< 0.1%

event_id
Numeric

Distinct count	196203
Unique (%)	100.0%
Missing (%)	0.0%
Missing (n)	0
Infinite (%)	0.0%
Infinite (n)	0

Mean	1629573.076
Minimum	20881
Maximum	3252924
Zeros (%)	0.0%

Toggle details

Quantile statistics

Minimum	20881
5-th percentile	176715.5
Q1	815183.5
Median	1628160
Q3	2440303
95-th percentile	3091701.1
Maximum	3252924
Range	3232043
Interquartile range	1625119.5

Descriptive statistics

Standard deviation	935423.8022
Coef of variation	0.5740299813
Kurtosis	-1.209810123
Mean	1629573.076
MAD	810671.3228
Skewness	0.01053273643
Sum	3.197271262e+11
Variance	8.750176898e+11
Memory size	1.5 MiB

Histogram with fixed size bins (bins=50)

Histogram with variable size bins (bins=[ 20881. 74788.5 120023.5 123322. 202454.5 ... 2603128.5 2606569. 2630935. 2637331.5 3252924. ], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
786431	1	< 0.1%
872546	1	< 0.1%
1850490	1	< 0.1%
2072936	1	< 0.1%
2962782	1	< 0.1%
610409	1	< 0.1%
713264	1	< 0.1%
713390	1	< 0.1%
610406	1	< 0.1%
1220811	1	< 0.1%
Other values (196193)	196193	> 99.9%

Minimum 5 values

Value	Count	Frequency (%)
20881	1	< 0.1%
20883	1	< 0.1%
21055	1	< 0.1%
21058	1	< 0.1%
21277	1	< 0.1%

Maximum 5 values

Value	Count	Frequency (%)
3252924	1	< 0.1%
3252921	1	< 0.1%
3252899	1	< 0.1%
3252879	1	< 0.1%
3252878	1	< 0.1%

latitude
Numeric

Distinct count	7314
Unique (%)	3.7%
Missing (%)	0.0%
Missing (n)	0
Infinite (%)	0.0%
Infinite (n)	0

Mean	22.98882747
Minimum	21.806773
Maximum	27.147792
Zeros (%)	0.0%

Toggle details

Quantile statistics

Minimum	21.806773
5-th percentile	22.582249
Q1	22.609044
Median	22.644512
Q3	22.825356
95-th percentile	25.476231
Maximum	27.147792
Range	5.341019
Interquartile range	0.216312

Descriptive statistics

Standard deviation	0.9172970793
Coef of variation	0.03990186452
Kurtosis	8.365922274
Mean	22.98882747
MAD	0.553409874
Skewness	2.983823957
Sum	4510476.916
Variance	0.8414339317
Memory size	1.5 MiB

Histogram with fixed size bins (bins=50)

Histogram with variable size bins (bins=[21.806773 21.806847 21.8145075 21.8281695 21.8282865 ... 27.1295945 27.1392895 27.145219 27.147449 27.147792 ], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
22.95798	777	0.4%
25.484459	561	0.3%
22.806273	355	0.2%
26.75609	352	0.2%
22.750621	344	0.2%
22.756079	330	0.2%
23.70973	287	0.1%
22.530119	275	0.1%
23.020517	269	0.1%
23.75607	267	0.1%
Other values (7304)	192386	98.1%

Minimum 5 values

Value	Count	Frequency (%)
21.806773	178	0.1%
21.806921	2	< 0.1%
21.810245	4	< 0.1%
21.811075	3	< 0.1%
21.81794	27	< 0.1%

Maximum 5 values

Value	Count	Frequency (%)
27.147792	14	< 0.1%
27.147106	1	< 0.1%
27.143332	243	0.1%
27.135247	6	< 0.1%
27.132306	3	< 0.1%

longitude
Numeric

Distinct count	7259
Unique (%)	3.7%
Missing (%)	0.0%
Missing (n)	0
Infinite (%)	0.0%
Infinite (n)	0

Mean	88.34604679
Minimum	86.371717
Maximum	89.622073
Zeros (%)	0.0%

Toggle details

Quantile statistics

Minimum	86.371717
5-th percentile	87.425562
Q1	88.381672
Median	88.412353
Q3	88.443469
95-th percentile	88.579227
Maximum	89.622073
Range	3.250356
Interquartile range	0.061797

Descriptive statistics

Standard deviation	0.3440938498
Coef of variation	0.003894841505
Kurtosis	8.402974835
Mean	88.34604679
MAD	0.1812864749
Skewness	-2.036429841
Sum	17333759.42
Variance	0.1184005775
Memory size	1.5 MiB

Histogram with fixed size bins (bins=50)

Histogram with variable size bins (bins=[86.371717 86.3730595 86.387368 86.392515 86.4031505 ... 89.5767465 89.5850595 89.613168 89.6170965 89.622073 ], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
87.81271	777	0.4%
88.619418	561	0.3%
88.459303	355	0.2%
88.442747	355	0.2%
89.067475	352	0.2%
87.794606	330	0.2%
88.3968	311	0.2%
87.125649	287	0.1%
88.183383	275	0.1%
88.526978	269	0.1%
Other values (7249)	192331	98.0%

Minimum 5 values

Value	Count	Frequency (%)
86.371717	20	< 0.1%
86.374402	7	< 0.1%
86.379668	1	< 0.1%
86.382335	1	< 0.1%
86.392401	127	0.1%

Maximum 5 values

Value	Count	Frequency (%)
89.622073	5	< 0.1%
89.61824	8	< 0.1%
89.615953	49	< 0.1%
89.610383	10	< 0.1%
89.605458	24	< 0.1%

state
Constant

This variable is constant and should be ignored for analysis

Constant value	WestBengal

timestamp
Date

Distinct count	161928
Unique (%)	82.5%
Missing (%)	0.0%
Missing (n)	0
Infinite (%)	0.0%
Infinite (n)	0

Minimum	2016-04-30 23:52:42
Maximum	2016-05-07 23:58:45

Toggle details

Histogram of 'timestamp' (bins=N)

Count
Matrix

First rows

	city	device_id	df_index	event_id	latitude	longitude	state	timestamp
0	Calcutta	6,173,131,034,529,612,800.0	2829979	74,778.0	22.7	88.4	WestBengal	2016-05-01 08:02:02
1	Calcutta	6,173,131,034,529,612,800.0	2829980	527,238.0	22.7	88.4	WestBengal	2016-05-02 21:03:22
2	Calcutta	6,173,131,034,529,612,800.0	2829981	1,264,753.0	22.7	88.4	WestBengal	2016-05-06 21:36:26
3	Calcutta	6,173,131,034,529,612,800.0	2829982	2,252,310.0	22.7	88.4	WestBengal	2016-05-03 23:02:19
4	Calcutta	6,173,131,034,529,612,800.0	2829983	2,318,262.0	22.7	88.4	WestBengal	2016-05-03 09:11:20
5	Calcutta	6,173,131,034,529,612,800.0	2829984	2,702,195.0	22.7	88.4	WestBengal	2016-05-06 14:14:55
6	Calcutta	-5,235,317,150,879,700,992.0	2829985	74,799.0	22.6	88.4	WestBengal	2016-05-01 08:04:22
7	Calcutta	-5,235,317,150,879,700,992.0	2829986	125,577.0	22.6	88.4	WestBengal	2016-05-03 08:06:37
8	Calcutta	-5,235,317,150,879,700,992.0	2829987	158,832.0	22.6	88.4	WestBengal	2016-05-02 20:04:02
9	Calcutta	-5,235,317,150,879,700,992.0	2829988	314,703.0	22.6	88.4	WestBengal	2016-05-07 17:48:07

Last rows

	city	device_id	df_index	event_id	latitude	longitude	state	timestamp
196193	Midnapur	-4,919,174,698,385,835,008.0	3252919	3,184,776.0	22.3	87.2	WestBengal	2016-05-01 21:30:13
196194	Ulubaria	-4,552,285,837,066,377,728.0	3252923	3,192,738.0	22.6	88.2	WestBengal	2016-05-04 09:23:07
196195	Halisahar	1,519,551,036,077,466,624.0	3252924	3,194,163.0	23.0	88.5	WestBengal	2016-05-02 10:05:51
196196	Bhatpara	-5,129,956,098,559,089,664.0	3252931	3,211,952.0	22.9	88.5	WestBengal	2016-05-01 21:35:47
196197	Kharagpur	7,270,157,325,938,748,416.0	3252935	3,225,021.0	22.4	87.4	WestBengal	2016-05-01 07:35:56
196198	Ulubaria	-8,840,776,028,151,301,120.0	3252936	3,226,367.0	22.5	88.2	WestBengal	2016-05-07 07:17:30
196199	Chandannagar	2,605,489,749,424,531,456.0	3252939	3,233,027.0	22.9	88.5	WestBengal	2016-05-07 11:04:27
196200	Khardaha	2,635,834,801,405,064,192.0	3252941	3,236,035.0	22.7	88.5	WestBengal	2016-05-06 13:51:35
196201	Jangipur	8,855,297,542,706,204,672.0	3252946	3,241,929.0	24.6	88.1	WestBengal	2016-05-05 17:05:08
196202	Bally	7,886,184,544,906,737,664.0	3252948	3,248,517.0	22.7	88.4	WestBengal	2016-05-04 21:35:09

Overview

Variables

Correlations

Missing values

Sample

First rows

Last rows